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) Embedded optical calibration system. 

) A method and system for calibration of opti- 
cal systems is disclosed. The system consists of 
a reference source (12), a spatial light mod- 
ulator (26) for transmitting the reference source 
signal with uniformity into the input of an opti- 
cal system (36). The output of the optical system 
is then compared to the input signal and a 
correction is derived. The correction is stored 
and used real-time to adjust the output of the 
system to more accurately reflect the actual 
input signal. 
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FIELD OF THE INVENTION 

This invention relates to optical systems, more 
particularly a method of calibrating such systems. 

BACKGROUND OF THE INVENTION 

Certain optical systems require calibration for op- 
timal performance. For example, systems with sen- 
sors, such as Forward-Looking Infrared (FLIR) detec- 
tion systems, vary in responsivity over time and from 
pixel to pixel. To overcome this, the operators typical- 
ly perform some type of calibration. The calibration al- 
lows a correction to the sensor reading before the 
data appears on a display, making the reading more 
accurate. 

This concept applies to other types of systems. 
Systems that receive scenes in color can use this cal- 
ibration to adjust for color brightness, balance, and 
saturation. Similarly, black and white systems could 
use it to adjust grey-scale readings or outputs. 

Problems exist in the current ways calibration oc- 
curs. Calibration systems require longer periods of 
time than desired by the operators. These systems or 
circuits normally take up quite a bit of space, and use 
more power than desired. Another significant prob- 
lem resides in the uniformity of the reference source 
into the system, and the difficulty of isolating the ref- 
erence from the sensor during normal operation. 

In a FLIR, for example, the calibration occurs us- 
ing a reference source that has two known tempera- 
tures. The temperature mix travels through non-imag- 
ing optics to the system sensors. The sensor reads 
the mix and produces a temperature reading. The dif- 
ficulty lies in controlling the mix of the two tempera- 
tures. 

SUMMARY OF THE INVENTION 

The present invention disclosed herein compris- 
es a system and method for calibration of heat- 
sensing systems, such as infrared and optical sen- 
sors, color systems, and other optical systems that 
desire calibration. The reference is set to a known 
combination of discrete temperatures or colors. The 
spatial light modulator controls the mixture of these 
temperatures or colors and transmits it uniformly into 
the system awaiting calibration. The actual input ver- 
sus the resulting output results in a correction for 
each pixel for a more accurate result when the system 
operates on unknown inputs. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the pres- 
ent invention and for further advantages thereof, ref- 
erence is now made, by way of example, to the follow- 
ing Detailed Description taken in conjunction with the 



accompanying drawings in which: 

FIGURE 1 shows a system used to generate a 
known input for calibration. 

FIGURE 2 shows a system to calibrate a staring 
5 array. 

FIGURE 3 shows a reference source. 
FIGURE 4 shows a membrane DMD designed for 
uniform mixing of the reference source. 

FIGURE 5 graphs a possible correction line for 
to pixels in the calibrated system. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

15 Figure 1 shows a top view of the calibration sys- 

tem before the signals enter the optical system. Ref- 
erence source 12 outputs some known signal, possi- 
bly a combination of discrete temperatures or colors. 
The light carrying known signal travels along path 14 
20 to lens element 1 6. Lens 1 6 transmits the light to opt- 
ical projection stop 18, a fold mirror, as an example. 
The light reflects off the stop 1 8 along path 20 to lens 
element 22. The lens element 22 images the light onto 
a spatial light modulator 26 via path 24. If the spatial 
25 light modulator is active, the light will reflect from it 
and miss the stop 18, travelling along path 24 to path 
28. If the spatial light modulator is inactive, the light 
will reflect as if off a flat mirror and return to the 
source via paths 24, 20, and 14. 
so An active spatial light modulator, such as a re- 

flecting liquid crystal cell, or a membrane deformable 
mirror or device (DMD), will diffuse the light around 
or pass it through the stop 18 and allow it to impinge 
upon chopper 34. This offers additional control over 
35 the transmission to the non-imaging optics 30. Adisk 
with a wedge taken out and a drive motor or coil 35 
often comprise a chopper. The non-imaging optics 
could consist of many things, such as a ground glass 
panel. They may also involve some imaging optics 
40 such as a lens before the panel, depending upon the 
application. 

In a system such as a FLIR, the non-imaging op- 
tics diffuse the image of the reference source to pro- 
duce a more uniform mix of temperatures for the sys- 
45 tern under calibration. After passing through the non- 
imaging optics, the light travels to the optics of the 
system. Finally, the calibration signal travels to the 
optics of the system under calibration in the direction 
of arrow 36. 

50 A staring array system is shown in Figure 2. A 

staring array could be a FLIR or any sensor system 
that "stares" at a scene. The scene enters the system 
via collecting lens 38. Possibly some type of relay 
lens 40 could be used to pass the image to the detec- 

55 tor. Chopper 34 regulates when the detector 25 and 
its imaging lens 42 receives the image. If the calibra- 
tion is to be done off-line, the chopper could be acti- 
vated to prevent the detector 25 from receiving any 
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lightfrom the lenses 38 and 40. The dotted line 1 7 rep- 
resents the optical axes of the system, and to further 
clarify the relationship between the different modules 
of the system. 

The calibration system consists of reference 
source 12, which is imaged onto the DMD 26 by the 
lenses 16 and 22, along paths 14 and 20. Light re- 
flects off projection stop 18 and travels through lens 
22 to the deformable mirror or device 26. Again, as in 
Figure 1, if the membrane is activated, light will pass 
the projection stop 18 and travel into the pupil of the 
imaging system of the detector. 

The imaging system of the detector is shown here 
as only one element 42. In this case, the pupil of the 
imaging system is as shown, 43. The pupil of an opt- 
ical system is the limiting aperture, either physical or 
effective, through which all of the light that forms an 
image passes. Light from each object point passes 
through every part of the pupil, and each image point 
receives light from every part of the pupil. Thus, in a 
sensor system, every detector element receives en- 
ergy from every part of the pupil. The important as- 
pect of imaging the calibration signal into the pupil is 
that every detector will then receive exactly the same 
mixture of signals from the discrete calibration sourc- 
es. 



Figure 3 shows an enlargement of the reference 
source 12. The reference source can send any mix- 
ture of signals desired. One such possibility, such as 
in the FLIR application, has a cold background 46, 30 
with hot bars 44. The cold background stays atT, and 
the hot bar has a temperature of T 2 . A uniform mix of 
these would result in a known temperature into the 
system. Alternately, the bars 44 map consist of a col- 
or such as red, and the background 46 as blue, both 35 
shades of known wavelengths. If the designer uses a 
fast-enough processor, or can develop a correction 
scheme that does not require real-time adjustment, 
the calibration system could use three colors, such as 
red green and blue. The output of the calibration sys- 40 
tern must have a uniformity that allows the operator 
to rely on the known input. 

A spatial light modulator can perform this func- 
tion. Typically, spatial light modulators consist of indi- 
vidual cells or lines that can be independently control- 45 
led When the image of the reference source with 
bars 44 arrives at the spatial light modulator, the spa- 
tial light modulator can separate the two types of input 
from each other and re-mix them. Using the previous 
example of T, and T 2 , one can see in Figure 4 that ev- so 
ery other line on the modulator 26, starting with line 
48, corresponds to hot bars at T 2 . Every other line, 
starting with line 50, corresponds to the cold back- 
ground 46. All of the lines corresponding to hot act to- 
gether, as do the lines corresponding to cold. In this ss 
way, the operator can transmit a known mix of the two 
temperatures to the non-imaging optics that further 
diffuses the mix, making it more uniform. Additionally, 



the reference source may consist of the set up previ- 
ously mentioned, with hot bars on a cold background. 
The modulator would speed the process of calibrating 
one temperature at a time. The lines corresponding to 
the hot could become active and the system would 
only receive the hot temperature. With a quick switch 
in the addressing of the modulator, the cold temper- 
ature travels to the system. 

Either way, it is relatively easy using a spatial light 
modulator to determine a known mix of either color or 
heat and to derive a two point correction for each pix- 
el One type of spatial light modulator fits the require- 
ments of this method of calibration very well. The 
membrane type deformable mirror or type typically 
consists of a metal membrane on top of supports. The 
supports allow the membrane to deflect towards ad- 
dressing circuitry under the membrane by separating 
the membrane from the circuitry with an air gap. 
When the electrodes become active, the membrane 
deflects towards it, deforming, and incident light re- 
flects at an angle. The support material typically con- 
sists of a polymer, such as photoresist. How the poly- 
mer is etched, as determined by the access holes 
etched in the membrane, determines in what pattern 
the membrane deflects. Other types of modulators 
can meet the requirements, such as liquid crystal 
cells, thin film modulators and electro-optic crystals, 
as well as digital micromirror devices (also known as 
DMDs). Thedigital micromirror or is very similar to de- 
formable mirror devices, except the membrane has 
been replaced by an array of individual mirrors sus- 
pended on supports over the electrodes, and each 
mirror has at least one dedicated electrode. 

A correction calculation example is in Figure 5. 
The horizontal axis 52 represents temperature, with 
demarcations for mix 1, 56a, and mix 2, 56b. The vert- 
ical axis represents the output. The upper curve 62 
represents the actual readings for a pixel that for dis- 
cussion will be called pixel N. The curve is derived by 
taking the output readings for pixel N at the two 
marked temperatures, point 64a and 64b. Line 58 rep- 
resents the perfect pixel response. Line 60 is the cor- 
rection line for pixel N. Typically, the correction is tak- 
en by comparing the pixel N response to the perfect 
pixel response. This makes for a correction that is 
less accurate than desired. By drawing a line through 
the points 64a and 64b. the calibration system de- 
rives a two-point correction for pixel N. The line 60 
takes the equation y = mx + b, where y is the output 
read, m is the slope of the line, and b is the intercept. 
The actual input, then, is (y-b)/m, where x is the actual 
input. 

This two-point correction gives a more accurate 
correction than the original comparison against the 
perfect pixel response. Asecond example is shown is 
curve 68 with points 70a and 70b. The line 66 repre- 
sents the correction for another pixel, pixel N+1 . The 
calibration system stores these corrections on a pix- 
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el-by-pixel basis and uses them to correct the output 
of the sensor before displaying the data. The example 
used above mentioned and traced the use for FLIRs, 
but again could apply to any optical system desiring 
correction. As mentioned previously, the system 
could use three or more values, depending mostly 
upon the speed of the processor for making multiple- 
point corrections in real-time. The more data po.nts 
available, the more accurate the correction. For ex- 
ample, a color system may use red, green, or blue, or 
a monochrome system may use different levels of 
grey-scale. 

Another application could be an automated color 
tunerfor television sets. The userflips a switch for cal- 
ibration of the color system, the system activates sen- 
sors and compares the actual color sensed to the col- 
or input and stores the corrections. Alternately, the 
calibration system could always be on, using one part 
of the input signal as the reference source, detecting 
any differences at the output and adjusting for it au- 
tomatically. When the system completes the calibra- 
tion task, the resulting picture has better color satur- 
ation and brightness, possibly even better than the 
user could do alone. Many other systems could ben- 
efit such as monochrome and color monitors, copiers 
in adjusting grey-scale values or colors, and pr.nt.ng 

SySt The system to make and store this correction 
could be as simple as a comparator comparing values 
between two photosensitive detectors, where there is 
one detector for the input to the system and one de- 
tector to the output of the system. The correction de- 
rived from the comparison could then be stored in 
some sort of memory, such as a mapping table. When 
the system resumes normal operation, or if it has 
been operating normally with the calibration system 
on the mapping table will provide the information to 
correct the output of the system for accurate presen- 
tation of the input 

Thus, although there has been described to this 
point particular embodiments of a method and system 
for calibration of optical systems it is not intended that 
such specific references be considered as lim.tat.ons 
upon the scope of this invention except .n-so-far as 
set forth in the following claims. 

The optical system can be used for many appli- 
cations, including infra red systems, visual d.splay 
systems, photocopier systems and the like. 



1. An optical system comprising: 

a reference source capable of producing at 
least one input signal wherein the value of the in- 
put signal is known; 

a spatial light modulator for directing said 
input signal from said reference source to an input 



of said optical system; 

output means capable of producing an out- 
put signal from said optical system; and 

comparing and storing means capable of 
5 comparing the inputand output of the optical sys- 

tem, thereby deriving a correction factor based 
upon that comparison and storing said correction 
factor. 

10 2 An optical system according to claim 1 in the form 
of a calibratable heat sensing optical system. 

3. An optical system according to claim 1 or claim 2, 
wherein the spatial light modulator comprises a 
15 deformable mirror device (DMD). 

4 An optical system according to claim 1 or claim 2, 
wherein the spatial light modulator comprises a 
digital micromirror device. 

20 5 An optical system according to claim 1 or claim 2, 
wherein the spatial light modulator comprises a 
liquid crystal array. 

2 « 6. An optical system according to any preceding 
claim, wherein the comparing and storing means 
comprises a microprocessor. 

7 An optical system according to any preceding 
3 o claim, wherein the reference source comprises 

one or more discrete signals the or each having 
a known temperature. 

8 An optical system according to claim 7, wherein 
35 the system can calibrate the temperature profile 

of an image by comparison with said discrete sig- 
nals. 

9. A method of calibrating an optical system com- 
40 prising: 

providing a reference source capable of 
producing at least one input, wherein the value of 
said input is known; 

transmitting the image of the reference 
45 source to an input of an optical system with a spa- 

tial light modulator; 

producing an output signal with said opti- 
cal system; 

comparing the input signal with the output 

so signal; and 

deriving and storing a correction for said 
optical system. 

10 The method of claim 9. wherein said comparing 
step further comprises using a comparator to 
compare between at least two photodetectors. 

11. A method of operating a display system compris- 
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ing: 

providing a calibration system, which is ca- 
pable of: 

establishing a reference source; 

operating a spatial light modulator for 5 
transmitting an image of said reference source; 
and 

transmitting said image of said reference 
source from said spatial light modulator to non- 
imaging optics and transmitting said image uni- 10 
formly to the input of said display system; 

comparing said input of said display sys- 
tem with the output of said display system; 

deriving a correction for each pixel at said 
output of said display system; and 15 

storing said correction. 
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